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ABSTRACT 


Many pages have been devoted to the development of the theory and appli- 
cation of convolution. In fact one might ask, "Why write any additional pages 
unless some fundamental contribution or additional degree of sophistication is 
added?" A reasonable answer to this question is that most of these pages are 
devoted to a rigorous analytical treatment or a discussion to support a special- 
ized subject. The purpose of this paper is to pursue a graphical approach with 
sufficient analytical support to clearly illustrate the mathematical operations 
involved, the physical significance, and some important areas of application of 
convolution in a manner as simple and direct as possible. 
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A GRAPHICAL APPROACH TO CONVOLUTION 


GENERAL COMMENTS 


Convolution is a powerful tool in communication theory and system 
analysis, both from a theoretical and a physical applications point of view. It 
provides a convenient method to relate the convolution of two functions in the time 
domain to the product of their spectra in the frequency domain, thereby offering, 
in many cases, a more convenient means of finding the inverse transform of 
certain functions . It offers a convenient method of evaluating the response of a 
linear system to an arbitrary excitation function in terms of its response to an 
impulse function. Furthermore, it provides a means of graphical solution when 
the functions involved cannot be expressed by analytical means, and it is most 
helpful in visually displaying relatively abstract concepts . Convolution is not a 
Fourier or Laplace transformation, although it is used extensively with trans- 
formation methods. It is an operation in its own right and obeys the distributive, 
associative, and commutative laws of algebra. Convolution of two functions 
resembles cross -correlation in that both include displacement, multiplication, 
and integration. However, convolution includes a folding or reflection which 
cross-correlation does not. The convolution of two functions, fj(t) and f2(t) , 
is generally written as f 2 (t) * f 2 (t) and is accomplished by folding one of the 
functions, shifting or displacing it by a given amount, multiplying it by the other 
function, and integrating the product curve over its domain of definition. Another 
solution would be to say the convolution of two functions can be obtained by scanning 
one of the functions with each element of the other function from -» to+» and 
summing the products at each point of the scan. 

Because of the product or the overlap of the two functions, the convolu- 
tion function is extended beyond the bounds of either function. Mathematically, 
the con’’ ition of f t (t) with f 2 (t) is written 


+ 00 

fl(t)*f 2 (t) = / f 1 (r)f 2 (t-T)dT . 

•00 


(1) 



The expression on the right-hand side of equation ( 1) is the convolution integral. 
Sometimes it is called the Faltung integral. The notation in equation (1) is quite 
popular and it should be noted that a dummy integration variable r has been 
introduced so that f t ( t) becomes ^(t) and f 2 (t) becomes f 2 (T) . The function 
f 2 (r) is folded by the substitution of -t for t and is displaced along the T-axis 
by an amount t. Either function could have been chosen to fold. However, once 
the choice is made, the folded function is the one that must be shifted. As a 
general rule, the simplest function is folded. Sometimes equation (1) is written 
as 

+ 00 

fi(T) ® f 2 (r) = J f i ( t ) f 2 (t — r) dT 

t -oo 

where it is understood that the variable of integration is the dummy variable t 
but the integral is indeed a function of the offset t. For each offset value of t, 
the product curve fj(T)f 2 (t - t) is integrated from -«° to +«> . 

The convolution of two functions can often be evaluated graphically when 
the functions are so complicated that they defy analytical integration. Also they 
may be curves arrived at by experiment which cannot be expressed analytically. 
Therefore it is most important to understand the folding, displacement, product, 
and summation steps that are embodied in equation (1) . 


GRAPHICAL INTERPRETATION OF CONVOLUTION 


Remembering the preceding general remarks, we will depart from the 
usual analytical approach to convolution and discuss the graphical procedures 
that lead to solution in considerable detail. It is believed that this approach 
will supply a better understanding of the physical significance than the more 
abstract analytical analysis. First, folding and displacement will be discussed, 
and then the product of the two functions as one is successively displaced will 
follow. Final’ y, the area under the product curve will be plotted as a function 
of the displacement or the offset. This is the convolution function. 

Consider a function f 2 (t) , shown in Figure la, in which a variable r 
has been introduced in Figure lb. It is possible to fold f 2 (T) around r = 0 (and 
this fact is important in convolution) by substituting -r as illustrated in Figure 
2a. This folding operation is the essential difference between convolution and 
cross -correlation. Figure 2b illustrates the folded function f 2 ( -r) shifted to the 
right in the positive direction along the T-axis by an amount t. The folded and 
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FIGURE 2 
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shifted function is now expressed as f 2 (t - r) . If the function had been shifted 
to the left in the direction of the negative T-axis, it would be expressed as 
f 2( -t - t) . Clearly for each value of t, there is a different position for the single 
pulse f 2 ( t - t) along the T-axis. Therefore by selecting successively larger 
positive values for t (t=l, t=2, t=3, . . . ) , the pulse is shifted along the T-axis 
in the positive direction. If another function fj(T) is plotted and f 2 (t - t) is 
shifted across fj(r), the area under the product curve (area under the curve 
obtained by multiplying the two functions in the region of overlap) is a function 
of the offset t. If the area under the product curve is plotted as a function of the 
offset t, the result is the locus of the convolution function fj ( t) * f 2 (t) . 

CONVOLUTION OF TWO SIMILAR PULSES fj(t) ■ f 2 <t) 

Two similar pulses, fj (t) = f 2 (t), are shown in Figures 3a and 3b. 

The dummy variable t is introduced directly in f t (t) . Since f 2 (t) is selected to 
be folded, -r is directly substituted for t, as shown in Figures 3c and 3d. For 
convenience, both functions are plotted on the same set of coordinates and the 
folded function is shifted by an arbitrary amount in the positive direction along 
the 7 -axis in Figure 3e. Since the folded function has been shifted by an amount 
t, it is expressed as f 2 (t - r) . Figure 4 shows six successive values of t as 
the function f 2 (t - t) is shifted across f^ ( r) . The "hashed" area is the area in 
which the two functions overlap. It is clear that the amplitude of the product of 
the two functions in the region of overlap is unity since the respective amplitudes 
aj = a 2 = !■• The area under this product curve for any offset t is simply 

A = a i a 2 At = 1 x 1 x At (2) 

where At is the amount of overlap and is clearly a function of t. Table I tabu- 
lates the pertinent graphical information shown in Figures 3 and 4. Now if we 
plot the area under the product curve versus t, we have the locus of the convo- 
lution function, as shown in Figure 5. The convolution of two similar rectangu- 
lar pulses results in a triangular spectrum . The range of the convolution is 
2.0 while the range of f 4 (t) = f 2 (t) = 1.0. 

Expansion of the foregoing graphical exercise is most convenient to 
illustrate the significance of equation (1) . This equation states that a product 
(curve) is formed by multiplying f^r) by f 2 (t - t) which has been folded and 
shifted by some value t. Furthermore, for each value of t the integral has a 
value which is obtained by integrating the product curve over the limits -« to 
+o» . Figure 6 is the result of redrawing Figure 4a. The region of overlap A t 
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TABLE I 


Figure 

Value of 
Offset t 

fi(T)f 2 (t - t) At 
Area Under the 
Product Curve for 
Offset t 

3c, 3d 

0 

0 No Overlap 

4a 

0.4 

0.4 

4b 

0.8 

0.8 

4c 

1.0 

1.0 

4d 

1.2 

0.8 

4e 

1.8 

0.4 

4f 

2.0 

0 No Overlap 
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FIGURE 6 

in Figure 4a has been divided into n increments of width Ar/n. Each incremen- 
tal area is 

AA = fjtrlfjtt - r) -~- 

where the area is a function of the offset t. Then the area under the product 
curve in the interval t=0 to t=0. 4 is the sum of all incremental areas within 
the interval 

t=°. 4 

A 8 Yi f l(T)f2(t - t) — • 
t=0 

From the fundamental theorem of integral calculus 

Lim t t 

At — o Jf 1 (r)f 2 (t - r) — — ■ = /f 1 (r)f 2 (t - t) dT 

n — oo 0 0 
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Since the product curve is zero outside the interval of overlap, nothing is 
added to the integral to replace the limits of integration by , +°° 

t +00 

/fi(T)fj(t - t) dr = f fi(r) f 2 ( t - t) dr • (3) 

0 -oo 

This is the convolution integral given in equation (1) . 


GRAPHICAL CONVOLUTION OF TWO DISSIMILAR PULSES 

fj(t) t f 2 (t) 


The convolution of two dissimilar rectangular pulses results in a trun- 
cated isoceles triangle; the sides become steeper as the width of the narrow 
pulse becomes more narrow. The understanding of this convolution leads con- 
veniently to an important property of convolution; that is, if a function f t ( t) is 
convolved with a delta function or unit impulse 6( t) , the result is the function 
fi( t) itself or 

fi(t)*6(t) = fj( t) . (4) 

This concept will be extended to show that if a function fj ( t) is convolved with 
a unit impulse function 6(t - t Q ) positioned at t = t Q , the function f 2 (t) is trans- 
lated along the t-axis in the positive direction by an amount t which is written 

fl(.t)* 6(t -t Q ) = f t (t - t Q ) . (5) 

The procedure will be identical with that of the graphical convolution of two 
similar rectangular pulses. However, f 2 (t) is chosen to be a narrow pulse com- 
pared to f j ( t) . Upon comparison of the two examples, it will be clear that as the 
width of f 2 becomes very narrow, the convolution function becomes more rec- 
tangular. Furthermore as the width becomes more narrow, the height of the 
convolution function decreases. If'the height of f 2 is allowed to increase as the 
width decreases in such a manner that the area becomes and remains unity, f 2 
becomes the delta function 6 (by definition) and equation (4) will hold. 

The two functions are illustrated in Figures 7a and 7b. A dummy 
variable t has been introduced in place of t in Figures 7c and 7d, and f 2 has 
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been rotated about the origin by substitution of -r for r. Both functions are 
drawn on the same coordinate system in Figure 7e. The function f 2 has been 
shifted along the positive direction of the r-axis by an amount t which causes an 
overlap At of fi(T) and the folded and shifted function f 2 (t - r) in Figure 7f. 

A product curve exists as long as the two functions overlap, and the area under 
this curve for each t is easily determined for this case by the simple product of 
the amplitude of each curve and the amount of overlap At which is 

A = f j ( t ) f 2 ( t - t) At = 1 x 1 x At . (6) 

Table II tabulates the area under the product curve for the corresponding offset 
t along with its functional overlap A t . The area under the product curve is plot- 
ted as a function of the offset in Figure 8. Comparison of Figure 8 with Figure 
5 illustrates graphically that as the width of one rectangular pulse becomes more 
narrow, the slopes of the sides of the product curve increase and the peak be- 
comes truncated and decreases in magnitude . In fact, the shape of the curve in 
Figure 8 begins to approach the shape of the function f t (t) , except the height is 
greatly reduced. 


TABLE II 


Offset 

t 

Overlap 

At 

Area Under 
Product Curve 
f 1 < T ) f 2 ( t - r) At 
for t 

0 

0 

0 

0.1 

0.1 

0.1 

0.2 

0.2 

0.2 

0.4 

0.2 

0.2 

0.6 

0.2 

0.2 

0.8 

0.2 

0.2 

1.0 

0.2 

0.2 

1.1 

0.1 

0.1 

1.2 

0 

0 
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FIGURE 8 

To more closely reproduce fj(t) we must increase the height of f 2 (t) as 
its width w is decreased. If we decrease the width and increase the height so 
the product of the width and the height equal unity, the maximum value of the 
area under the product curve will equal the amplitude of f t (t) throughout the 
region in which the overlap is constant (as the narrow pulse is shifted through 
the broad one) . This case is illustrated in Figure 9 where the function f 2 (t) of 
Figure 3a is chosen with an amplitude five times that of f t ( t) and with a width 
w which is one -fifth that of fj(t) . The area of the pulse is unity. Data for the 
graphical convolution of the functions of Figure 9 are tabulated in Table in and 
the convolution function is plotted in Figure 10. If the convolution f t (t) * f 2 (t) 
of Figure 10 is compared with f 4 (t) in Figure 3, it shows that 

fi(t)*f 2 (t) = f 2 (t) (7) 

for 0.2 < t < 1.0. As the width of f 2 (t) becomes very small and its ampli- 
tude is increased so the area remains unity, the equality of equation ( 7) holds 
over almost the entire range of f 2 (t) . Finally in the limit as the width approaches 
zero and the height approaches infinity, f 2 (t) becomes the Dirac delta function 
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or unit impulse <5(t), equation (7) becomes equation (4), and equation (1) may 
be rewritten as 

+ 00 

fi(t) * d(t) = J fj(T) fi(t-T)dr = f t (t) . (8) 


TABLE HI 


t 

A T 

fl ( t) f 2 ( t - t) At 

0 

0 

0 

0.1 

0.1 

0.5 

0.2 

0.2 

1.0 

0.4 

0.2 

1.0 

0.6 

0.2 

1.0 

0.8 

0.2 

1.0 

1.0 

0,2 

1.0 

1.1 

0. 1 

0.5 

1.2 

0 

0 


CONVOLUTION OF A FUNCTION WITH AN IMPULSE FUNCTION 


It is now convenient to consider the important case of convolving a 

function fj(t) with an impulse function 6< t — t ) positioned at t = t . First, as 

o o 

in the preceding example, we will convolve f 4 < t) with a narrow finite pulse 
f 2 (t - t Q ) that 'is positioned at t = t^. Both functions are shown in Figure 11a. 

A dummy variable is introduced in Figure lib. The function f 2 (r - t Q ) is rotated 

around the origin (t = 0) by substitution of -r in Figure He. Finally the rotated 
function is shifted in the positive direction along the r-axis by an amount t. The 
overlap At and the area under the product curve f 2 (r) f 2 ( t - t - t)At are tabu- 
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FIGURE 10 

lated for several corresponding values of t in Table IV. The convolution 
function is plotted in Figure 12. By comparing Figure 12 with Figure 10, the 
convolution function of Figure 12 is identical except it has been displaced by 
an amount t = t . Furthermore, as the width w of the function U is allowed 

to become smaller and smaller as the height is allowed to become greater 
and greater and the area is held constant at unity, the height of the plateau 
of Figure 12 remains equal to the amplitude of fj (which is 1. 0 in this case) 
over a larger and larger range of the offset t. Finally in the limit as f 2 (t-t Q ) 

becomes the delta function 6(t - t ) (which is a function with zero width, 

o 

infinite height, and unit area) the convolution function of Figure 12 becomes 
that of Figure 13, which is exactly that of fj(t) of Figure 11a shifted to the 
right by an amount t = t Q . 

From an analytical point of view, the same argument used to arrive at 
equation (3) yields 

+ 00 

f t (t)* f 2 (t - t Q ) = f f t (T)f 2 (t - t Q -T)dT 
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and as 


f:(i-t Q ) - 6(t-t Q ) 

+eo 

f,(t) *6(t-t o ) = / f t (T) d(t -t o -T)dr = f t (t - t Q ) . (9) 


DIRAC DELTA FUNCTION 


Expansion on the Dirac delta function should add substance to the previous 
discussion as well as enhance physical interpretation of subsequent convolution 
techniques. The delta function is a powerful tool in analyzing transformation 
problems. It may be regarded by the civil engineer as a concentrated load, by 
the electronic engineer as a unit impulse function, and by the physicist analyz- 
ing an optical system as a point (or line) source. In many applications the 
analyst may determine the response of a linear system to an arbitrary excita- 
tion function from its response to the delta function. This function is not an 
ordinary function in that it has a definite value for each point within the domain 
of definition and must be used with discretion to avoid inconsistencies. A r gor- 
ous treatment of the properties of the del+a function must be based upon dis- 
tribution theory rather than conventional mathematics . The delta function at 
the origin is defined to be zero everywhere except for t = 0 or 

6( t) = 0 t * 0 (10a) 

such that the area is unity 

+oo 

/ 6(t)dt = 1. (lOh) 

-OO 


This function is represented by Figure 14a, in which the function exists only at 
the point t - 0 and the one in parenthesis reminds us that the area of the function 
is unity. If the delta function is translated along the t-axis in the positive direc- 
tion by an amount t = t , 

o 


6(t = t ) = 0 t * t 
o o 


( 11a) 
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and the area is 


+oo 

/ 6(t-t )dt = l . (lib) 

-00 

In this case the function only exists at the point t = t , as shown in Figure 14b. 

o 




FIGURE 14 

A very important property of the delta function will be shown and sub- 
sequently utilized to analytically arrive at the convolution result given in equa- 
tion ( 9) . Figure 15 illustrates a function of a real variable t plotted along with 
a delta function positioned at t = t, which by definition does not exist at any 
point except t =t. The two functions intersect at f(t) = f(r) ; therefore 

f(t)6(t--r) = f(T)6(t-r) . (12a) 

Let t = a - t and we have 
o 

f(o - 1 ) 6(a - t - t) = f(T) 6(a - t - t ) . (12b) 

o o o 
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FIGURE 15 

Integrating equation (12a) over the range of t(-«° to +«) gives 
+00 +00 

f f(t)6(t-T)dt = jf f(T)6(t-T)dt • 


The factors in the integrands on both sides are equivalent from equation ( 12a) . 
However, the factor f(r) in the integrand on the right (equation 12a) is not a 
function of the variable of integration t and the right-hand side may be written 
as 


+ 0O 

f f( t) 6(t -r)dt 
-00 


+ 00 

f(T) / 6(t - r)dt 


-oo 


(13) 


and since by definition of the delta function the integral on the right is unity, 

+oo 

f(T) / 6(t -T)dt = f(T) (14) 

-oo 
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which states that multiplying a delta function 6(t - r) by the function of a real 
variable f(t) and integrating over a range of t from -« to +» is equivalent to 
substituting r for t. 

With the above principles in mind and with the aid of Figure 16, we have 

direct analytical proof of the important property that if a function f ( t) is convolved 

with the unit impulse function 6(t - t ) , the function f(t) is translated in the 

o 

positive direction along the t-axis by an amount t Q . Figure 16 shows that 


+ 00 

f(t)*6(t-t) = f f(T)6(t-t -T)dr . 

o J o 

-00 

The factors in the integrand are of the same form as equation (12b) ; therefore 

+ 00 

f(t)*6(t-t) = f f(t-t)6(t-t -r)dT . 

0 J o o 

—CO 

The factor f(t - t Q ) does not contain the variable of integration and is brought 
outside the integral 

+00 

f(t) * 6(t - t ) = f(t - t ) f 6(t - t - T)dT . 

0 o J o 

—oo 

By definition of a delta function the integral is unity and the convolution is 

f(t)* 6(t -t ) = f ( t - t ) (15) 

o o 

which is f(t) of Figure 16a displaced by an amount t = t . This is plotted in 
Figure 17. 


PRACTICAL IMPULSE FUNCTION 


From a practical point of view, the unit impulse function is generally 
regarded as an impulse of infinitesimal duration d r and an amplitude h which is 
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FIGURE 16 
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FIGURE 17 


large ( tends to infinity) . This very narrow and very long rectangular pulse has 
an area equal to unity which is an even function. Since the area is finite, the 
pulse can be integrated over its interval. This type of pulse is approximated by 
the application of a voltage for a very short duration or the instantaneous charge 
transfer. Quite often it is convenient and very useful to work with an impulse 
function rather than a unit impulse function. In this case, the impulse has an 
area other than unity. The area k of the impulse is regarded as its strength 
and is written as a coefficient in the form k 6(t - t Q ) . This type of impulse is 

similar to the delta function except that the amplitude is controllable. In truth, 
it is what one is most likely to encounter in practice. Subsequently it will be 
shown how a convolution can be built up from a succession of impulses of proper 
amplitude within a chosen interval. Figure 18a illustrates an impulse of width 
dT and height h with a strength k = hdT which is positioned symmetrically around 
t = t. The factor k gives the strength, and the factor 6(t - r) gives the position. 
Therefore the impulse may be shifted along the t-axis by selecting values of r. 
Suppose the height h of an impulse of constant but infinitesimal width dr follows 
some function f(t) . Then any impulse is written k. 6(t - t.) , as shown in 
Figure 18b, where k^ = h^dT = f(T,.)dT . 
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SCANNING AND SUPERPOSITION PROPERTIES OF CONVOLUTION 


It is important to note that when two functions are convolved, the result 
is the same as if one of the functions is scanned by each element of the other 
and the products are summed . Recognition of this scanning property leads 
directly to the realization that the convolution integral is in truth a superposition 
integral. Thus, if f 2 (t) is convolved with f 2 (t) , it is possible to partition f 2 (t) 
into small increments of width and convolve f t ( t) with each increment. A super- 
position of the incremental convolutions results in the total convolution 
fj(t) * f 2 ( t) • Strictly speaking, the superposition of the incremental convolu- 
tions approaches fj(t)* f 2 (t) as the incremental width of the partitions approaches 
an infinitesimal. In this case, the function f 2 (t) is thought to be divided into 
adjacent impulses such that any i^ 1 impulse is k. 6(t - t.) in which the impulse 

has a strength k. and is positioned at t^ along the t-axis. Each of these impulses 

within the domain of definition of the function f 2 (t) is then convolved with f t (t) . 
Superposition of all these convolutions yields the total convolution. This is 
easily shown by graphical means. Figures 3a and 3b are redrawn in Figure 19 
where f 2 (t) is partitioned into five increments (a, b, c, d, and e) of width d r 
and height h (h = 1 in this case) . The increments are respectively positioned 
at t Q , tj, t 2 , t 3 , and t«. These partitions are rather large to consider as im- 
pulse functions (a good approximation of the unit impulse is to choose a width 
dT so the impulse height will be 1/dr and the area dTX 1/dr = 1) . They are 
convenient for graphical illustration and, in this simple case, give ideal results. 
Impulse notation will be used to emphasize the convolution of partitions of a 
function f 2 (t) with f t (t) . The partition a of f 2 (t) in Figure 19 is clearly the 
function f 2 (t) in Figure 7a, whereas the function fj(t) of Figure 19 is the function 
f t ( t) of Figure 7b. The convolution function of the two dissimilar pulses shown 
in Figure 7 is plotted in Figure 8. Therefore the convolution function of the 
partition a of f 2 (t) with fj(t) in Figure 19 must be identical with the convolution 
function of Figure 8. This convolution f 4 < t) * k <5(t - t ) is plotted in Figure 20a. 

The other partitions are identical in width and height and only differ in succes- 
sive position along the t-axis. Therefore their convolution functions are identi- 
cal with that of partition a except they are successively displaced along the t-axis 
by an amount dr. These convolution functions are b, c, d, and e of Figure 20. 
Addition of the functions a, b, c, d, and e results in the convolution function 
fj( t) * f 2 (t) of Figure 20f which is identical with that of Figure 5. Therefore 
we may convolve fj(t) and f 2 (t) directly or we may partition f 2 (t) , convolve 
each partition with f 2 (t) , superimpose the convolutions, and arrive at the same 
result. 
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FIGURE IS 


CONVOLUTION AND THE RESPONSE OF A LINEAR SYSTEM 


The superposition properties of the convolution integral make it a most 
useful and convenient means of specifying the response of a linear system in 
terms of its impulse response and excitation function. In fact, a very important 
theorem sometimes referred to as Borel's theorem states, "The response of a 
linear system to an arbitrary excitation is the convolution of the excitation func- 
tion and the system impulse response. " Therefore if the impulse response of 
the system is once determined, it may be convolved with any arbitrary excitation 
function to result in an expression for the system response. The importance of 
this statement is magnified by the fact that if there is no analytical expression 
for the excitation function, the integral can be evaluated graphically. Further- 
more it is often convenient to partition the excitation function into a succession 
of impulses similar to the delta function except that the amplitudes are controlled 
according to the amplitude of the partitioned function. Convolving the system 
impulse function with each successive excitation impulse and superimposing the 
results gives the desired system response. The impulse response is most con- 
venient and widely used to characterize the input -output relations of a system 
and is defined in the following way. If the input excitation of a system is the 
delta function 6(t ) , the output response is the impulse response h(t) . Sometimes 
the impulse response is called Green’s function (by the field theorist) or the 
spread function (by the optical physicist) . 
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FIGURE 20 




Borel's theorem will be illustrated but not proved, although a rather 
general proof may be given without undue difficulty. (The proof is based on the 
classical theory of second-order linear differential equations, a modicum of 
operational calculus, and the definition of Green's function. ) In so doing,' con- 
sider a linear system such that an input delta function 6(t) causes an output h(t) 
as shown in Figure 21a. Since the system is said to be linear, the input and 
output could be represented by a differential equation with constant coefficients, 
and the invariance of the input and output relations would not be disturbed by a 
translation of time. Therefore if the input excitation is delayed by a time t = t, 
the output response is likewise delayed by a time t = r as shown in Figure 21b 
(this function is that of'fj(t) in Figure 19) , and by definition the impulse response 
of the system is h(t - t) . Let an arbitrary input excitation f.(t) (identical with 

f 2 (t) in Figure 19) be applied to the input as shown in Figure 21c. According to 
Borel's theorem the output response f Q (t) is the convolution of the excitation 

function f.(t) and the impulse response h(t - r) , and we may write 

f Q (t) = f.(t)*h(t) (16) 

which is 

+ 00 

f Q (t) = / f.(T)h(t -T)dT . (17) 

-oo 

A plot of the system response f^(t) is the same as that in Figure 20f. 

To emphasize the principle of linear superposition embodied in the 
integral of equation ( 17) , it will be developed with the aid of Figure 21. The 
input function f.(t) is partitioned in increments of width At and height f.(r) 

where the height is f.(t) evaluated at the position t of the given increment. As 

At becomes smaller, the fui: "ion f (t) becomes smaller, the function T( t) 

becomes more closely approximated by a series of adjacent impulses of strength 
k = f . ( t ) A t which are positioned at 6(t - t) ; therefore a typical input pulse is 

f.(T) AT6(t - t) . 

i 

If the increments are sufficiently small, the pulses approximate the unit impulse 
function (strength unity) so that, if the unit impulse function <5( t - t) results in 
a response h(t - t) , the incremental input impulse with strength f.(T) At located 

at 6(t - t) results in an incremental response (Figure 21c) . 
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3i 




Af (t) = f (T)Arh(t - t) 
o i 


( 18 ) 


According to th- principle of linear superposition, the response of a linear sys- 
tem to an excitation function f (t) up to a given time t is the sum of its responses 

to all of the incoming impulses up to the time t. In other words, we may add up 
all of the contributions (response) to the present time to arrive at the total. 

Therefore the sum of all the responses to the individual input impulses 
from t = 0 to the final time t is 

t 

f 0 (t) = ZV T)ATh(t_T) * (19) 

t=0 

It has been emphasized that as At becomes smaller (amplitude is now controlled 
to correspond with the amplitude of the input function) f.(t) is more closely 

approximated by the series of adjacent impulses; therefore equation (19) more 
closely approximates the system response. In the limit as At -► 0 the expres- 
sion 


Lim t 

f (t) = At — 0 V f.(T) h(t - t) At 
° UO 1 

becomes the integral 

t 

f(t) = ft. (T)h(t-T)dT (20) 

o J i 

which is a convolution integral that defines the system response in terms of the 
impulse response and the input. Equation (20) is sometimes referred to as the 
superposition theorem. 

Since the integral is zero for any value of t for which the product of the 
factors in the integrand is zero, nothing would be added to change the limits of 
the integral from t = -°° to +» and equation ( 20) becomes 
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( 21 ) 


+oo 

f (t)=/ f.(T) h(t -T)dr . 
-00 


Equation (21) holds if f.(t) and f Q (t) are periodic, aperiodic, or random. 


CONVOLUTION THEOREM 


From the standpoint of solving linear differential equations, the transfer 
function is the reciprocal of the characteristic function in the transform solution 
of all linear differential equations. From a systems point of view, it is simply 
the ratio of the response output transform to the excitation input transform and, 
in addition to the impulse response, is widely used to characterize tne input- 
output relations of a linear system. The transfer function is discussed here in 
the context of arriving at the v°ry important convolution theorem. 


If the input to a linear system f . ( t) Fourier transforms into F. ( qj ) and 

the output response f (t) Fourier transforms into F (cu) ; that is 
o o 


fF[t(t)] = F.(w) 
£F[f Q (t) ] = F o (co) , 


the transfer function H(u>) is by definition 


H(w) 


F (w) 
o 

F.(oj) 


and the Fourier transform of the output response is 
F q (o>) = H(w) F.(a>) . 


( 22 ) 


The inverse Fourier transform of equation (22) is the response of the system 
in terms of the transfer function and the input excitation 
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(23) 


f Q (t) = 3 r “ 1 [H(w) F.(o;) ] . 

By comparing equations (23) and (21) we can write 


+ 00 


/ f.<T)h(t- 
J 1 


t) dr 


3 7 ' 1 (H(w) F («)] 


(24a) 


or equally 


JF 


+ 00 

f f. ( t) h(t-T)dr 

J i 


H(w) F.(w) 

l 


(24b) 


Equations (24a) and (24b) are a form of the convolution theorem which shows 
the equivalence of two powerful methods of arriving at the response of a linear 
system. Whether the system response is determined by the convolution of the 
input and the impulse response or by the inverse of the product of the input and 
the transfer function transforms is a matter of choice . 


The convolution theorem is one of the most widely used tools in frequency 
analysis and is worthy of a more general statement and proof. Before doing so, 
however, the shifting theorem will be reviewed because it will be used in a very 
straightforward proof. According to the shifting theorem, if the Fourier trans- 
form of f 2 ( t) is 


JF(f 2 (t)] 


+oo 

= / f 2 (t) 


— oo 


e 


-ico t 


dt 


f 2 M 


(25) 


then the Fourier transform of f 2 (t - t) is 

fr[f 2 (t -r)] = e" 1C0T F 2 (a t) . (26) 

Equation ( 26) states that a shift of t in the time domain is equivalent to the 

multiplication by the factor e la>T in the frequency domain. To prove equation 
( 26) , it is only necessary to perform the operation indicated on the left-hand 
side of the equation which is 
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(27) 


{F [f 2 (t - r) ] 


f f2< t - t) e dt 


and make the substitution 
1 7 = t - T 


so that 


*Fl f 2 (t “ t) ] 


+ 00 

/ f 2 (v) e ~ la)(T) + T) d tj 


"i CUT 

The exponential factor in the integrand contains a factor e which does not 
contain the variable of integration and may be moved outside the integral , 


<F[f 2 (t -t)J = e 


-io>r 


+«o 


fhir,) 


e iwT, d tj 


-00 


The integral is clearly the Fourier transform of f 2 ( tj) and is identical in form 
with the Fourier transform of f 2 (t) in equation (25) ; therefore we may write 

JF[f z (t-r)] = e" lwT F 2 (w) (28) 

which is proof of the shifting theorem. 

Now it is convenient to state and prove the convolution theorem. If f t (t) 
transforms into F t (o;) and f 2 (t) transforms into F 2 (w) ; that is, if 

JF[fl(t)] = F t (w) 


and 


3 r [f 2 (t) ) = F 2 (w) 


then 

r+oo 

(F f fj( T ) f 2 (t -T)dr 


Fj(w) F 2 (a>) • 


(29) 
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To prove that equation (29) is true, it is necessary to perform the 
operation indicated on the left, and equation (29) becomes 


+00 

/ 


+ 00 


/ f t (r) f 2 (t - r)dr 


e“ 1Wt dt = F 1 (a>) F 2 (a;) 


To use the shifting theorem, the expression within the brackets of the 
above equation may be rearranged so that 


+oo 

/ fl(T) 


-00 


f f 2 (t - t) e 1COt dt 


dr 


F^w) F 2 (o>) . 


The expression within the brackets in the integral on the left-hand side of the 
above equation is the Fourier transform of the function f 2 (t - t) of equations 
(26) and (27); therefore 

+ 0O 

/ f t ( t ) F 2 M e“ lwT dr = F^w) F 2 (u) • 

-oo 


The factor F 2 (o>) in the integrand of the above integral does not contain 
the variable of integration and may be moved outside. 

+ 0 ° 

F 2 (u>) / Mr) e" WT d r = F t (w) F 2 (w) . 

-OO 

The integral is now the Fourier transform of fj ( r) , which is of the form 
fj(t) , and the result is 

Fj(o;) F 2 (oj; = Fj(ci)) F 2 ( w) 
which proves the convolution theorem. 
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